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Organizational Performance Solutions 


TURTLE RATTL 


CASPIAN LEARNING 


Integrated Learning Environment 
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Recurring Solution Requirements 

• Mature Technology 

• Enabled Work Force 

• Affordability 

• Precision 

• Articulation 

• Flexibility 

• Maintainability 
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SCORM 


“...Until now, it has been extremely difficult to track user activity within 3D games 
environments to industry standards. As such, training departments have been unable 
to monitor many learning improvements through this type of approach. LINE worked 
closely with Caspian Learning to produce the industry's first SCORM conformant 
3D serious games that feed user data and activity results to SCORM vl .2 and 
2004 conformant Learning Management Systems (LMSs).” 



Thinking Worlds ™ 
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Who are Caspian? 

Global Leaders in the use of 3D games technology for 
education and training: 

■ Motor 

■ Finance 

■ Technology 

■ Pharmaceuticals 

■ Publishing 

■ Education 

Delivering programmes for organisations such as: 
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What does Thinking Worlds do? 

“Delivers performance simulations and problem 
solving challenges in engaging 3D worlds, to 


improve learner motivation and skills" 
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•Learner Control 


•Personalisation 

•Exploration 


Context 


Motivation 

Challenge 

Competition 

Feedback 


•Safe Failure 

•Practice 

•Experiential 


Simulations 
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3D Worlds 


•Learner Control 


•Personalisation 

•Exploration 


•Context 
•Safe Failure 
•Practice 
•Experiential 


Simulations 





Types of learning journey 

■Trail Worlds™ - Directed Journeys 

■ Journey = Structured, Linear, Sequentially Progressive 
* Outeomes= Prescriptive, Explicit, Task based 

■ Use cases = Process, Procedure, Compliance, Regulatory, Knowledge 



Quest Worlds™ - Branching Journeys 

* Journey = Unfolding, Branching Structure, Personalized g§§g 

* Outcomes = Overall aims & goals with differentiated routes |||||| 
■ Use cases = Scenario based, Skills Improvement, Problem Solving 



■ Discovery Worlds™ - Open Journeys 

» Journey = Open ended, Learner controlled, Free form 

■ Outcomes = Engagement, Self Direction 

■ Use cases = Exploration, Familiarization, ITC's, New Roles 
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Five Ideal Appropriate Types Of VR 

Learner 


1. 

2 . 

3 . 

4 . 

5 . 


Disengaged and Disaffected learner 
Young & Media Savvy Learner 


Concrete Visual learner 
Competitive Learner 
Reluctant & Fearful learner 


Sales League Table ~ Universal 
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Isn't this the majority of learners we have? 
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Five appropriate types of learning 


1. Dull, Dry Content Jp|pB ^|g 

2. Risk Mitigation 

3. People Oriented Interactions 

4. Exploration and Familiarisation 

5. Decision Making and Problem Solving 


Isn't this the majority of learning we do? 
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The technology 


Thinking Worlds™ Applications 

■Use thinking skills to achieve learning 
outcomes within 3D virtual world 
■Subject specific applications 
■Mapped to objectives 
■Measure Thinking Skills performance 
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Levels of Leernincj / Performance 



Cognition Level 


Task Activity 
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The technology 

Thinking Worlds™ Authoring tool 

■ A rapid development tool 
- Delivers flexible solution 

■ Pedagogical templates 

■ Updateable 

■ Web centric 

■ Cost Effective 
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Oshynee 


Deploying Thinking Worlds TM 


Seminole Hard Rock Hotel Use Case 
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Oshynee Approach to Evaluation 

• The purpose of training, or managed learning, is 
to achieve predictable business outcomes. 

- A problem with training is that ideal behaviors in a training 
environment do not often predictably provide for performance 
under working environments 

- The performance domain is multivariate with environmental and 
internal barriers to performance 

- “Work experience” or “experiential learning” is the primary 
determinant of performance in the ‘real world’ 

• Oshynee evaluates workforces against 
workplace standards to determine proficiency 
and provide feedback that resolves differences 
between what has been learned and what is 
needed for success 
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Technical Description 


Oshynee’s precision Learning Objective performance factor rubrics 
with associated behavioral anchors integrates with Thinking 
Worlds™, to provide event data recording and dynamic prescriptive 
feedback. 


Thinking Worlds™ provides SCORM parametric data for reporting 
within the game ana within overarching curricula or workplace 
evaluation strategy. 

- Open-sourced, browser-based digital dashboard reporting tools collect 
data from TW, LMS, LCMS, HR, and workplace metrics or control 
systems 


The games may be delivered across the internet or in a range of 
networked and stand-alone methods using the delivery model (s) 
required by the host organization. 
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When looking in the bathroom which of the following 
was standards/ ' ■; 


Activity Information 
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Example Storyboard-Rubric 



\ 
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Gaming Scenario: Irate Customer: Issue surroundinq a sub-standard room 


Hard Rock Casino: STORY BOARD OF EVENTS 


Event 3: 

Video sequence 
illustrating the 
player moving 
across the lobby 
to the lifts and into 
the customers ' | 

room. 


Event 4: 

Player explores 
the room 
environment. 
This will last 
approximately 
60-120 seconds, 
the player will be 
prompted to look 
for issues. 


Event 1 : 

Player moves 
towards telephone 
and has an 
interactive 
conversation 
with customer. 


Event 2 : 

Player interacts 
with the manager 
and summarizes 
the conversation 
and details 
of issues). 


Possible task and 
here if the 
conversation is not 
handled well, 
scenario restarted. 


Possible task and 
here if the 
conversation is not 
handled well, 
scenario restarted. 


Rubric Performance Dimensions 


Event 4 : 

Adherence to Policy 

Problem Identification 

Verbal / Nonverbal Communication 


Event 2 : Event 3 : 

Verbal /Nonverbal Communication Verbal / Nonverbal Communication Safety 
Adherence to Policy Adherence to Policy Adherence to Policy 

Problem Identification 
Solution-Oriented 
Decision Making 
Passive/Aggressive 


• Each event within the Simulation contains specific behavioral aspects of customer service which 
measured against standard performance criteria across multiple levels of proficiency 
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Performance Factor Dimensions: Knowledge and skills 
associated with a given task 


Performance Criteria Outlined in Example 

Rubric 


Perforr me ' ' 

~ Performance Factor Dimension 
Difrem'ionc Definitions 

Illllllllilllill 

M ' ‘ \ : . li-lll ' §;1 II 

P 

Sub-Optima! UNSET 

Communicates in a manner, 
tnat is difficult to Mow./ 
May tend to ether fragmaf 
thoughts or ramble;# 
Communicates with Med 
energy, corsf^encejp 
personal convidi* 

llllllrlllll IlilllllS IIS 

ssstve 

^^Tub-Optimal \ 

Behavioral Anchors 
Optimal 

Aggressiv 

Sub-Optimal 

e 

Sub-Optimal UNSET 

Communicates with 
elevated levels of negative 


T bs extent i0 which the job incumbent 
mtm S i uses P ro P er vocabulary (e.g , “Certainly”, 
CGlTHYHinlcsfi “I'd be happy to", “My pleasure") and 
engages in empathetic communication 
A N | techniques with guests 

Communicates with respect arid 
courtesy toward aS customers; 

Uses a tone of voice that 
sounds courteous or pleasant. 
Other nonverbal behaviors do 
not contradict the customer 
service message; Uses familiar 
language but may also use 

Vommunicates with resped and courtesy 
toward all quests at all times; uses a tone of 
vose that suggests 1 want to help." Vocal 
tole and otter nonverbal behaviors an^" 
consltent with a postive, cus^mef^vice 
messaab; uses precip^^cToete, jargon free 
I^-^nguage. 

Communicates with respect and 
courtesy toward some customers; 

Behavioral Anchor: Standard 
specific for Passive and 
Aggressive behaviors 

Tte extent to which the job incumbent 
bOIUuGJT , ccrsiders the relative costs and benefits of 
Oriented ;: potential actions in order to choose the 

Decision- 'f wost appropriate solution, while meeting 
' Making ' ^ !8 s u9sts n88 ^ s > m d maintaining a goal 

directed activity 

Does not choose s< 
wihtheorganizatic 
interest: in mind; mai 
decisions that do r 
the guests ne 

pons 
|s best: 
is poor 
rtmeet 
ds 

Chooses solutions without 
regard to the relative costs and 
benefits of the action at hand 

Consida 

potential! 

appro? 

exceeding 

i the relative costs and benefits of 
Jons in order to choose the most 
iaie solution, while meeting and 
le guests needs, and maintaining a 
goal directed activity 

worKs Tor me cl^mer WTiyihg To 
identify mutually beneficial solutions 
to problems; the guests needs are 
met, however, expectations are not 
exceeded 

Chooses solutions without 
regard to the guests 
needs or organizational 
goals 


ilSpliiilSfi ^ 8 extent incumbent 

. identifies the potential problems and/or 

■ ■ guests needs 

Unaware of prohte 

environment or t 
needs 

sin the 
ests 

identifies obvious needs when j 
dearly stated by the customer. | 
However, generally does not 
probe for additional information 
by asking questions, etc. in 

Identifies 

asking 

(summariz 

iddiional heeds of customers by 
uestionsand listening actively 
3, paraphrasing, asking questions, 
etc.). 

Identifies guest needs, however, may 
probe too much for information 

Asks to many questions, 
invasive!'/ probes for 
information, however 
does not successfully 
identify guest needs 

- - Extent to which the job incumbent creates 

a safe, secure, accident free environment, 
and is aware of all ire and safety 
!H HU*I emergency procedures and reports security 

Fails to comply will 
procedures, <polc’; 
detect safety haze 
the environmei 

Safety 
Its in 

Adheres to safety 
proceduresfpoficy, however, 
does not actively seek o ut 
potential safety hazards 

Creati 

environs 

emergent 

s a safe, secure, accident free 
ent; is aware ofa's fire and safety 
procedures; reports security risks 
immediately 

Adheres to safety procedures&oiicy, 
however, continuously seeks out 
potential safety hazards to the point 
of guest disturbance 

Produces new safety 
procedures/polcy, 
however, they are often 
unneeded, costly and time- 
intensive 

Adherence to 

•iPrdcedures Extent of compliance with company 

’ r ■ endorsed principles 

Fails to comply wi 
organizational \ 
i procedjres/pofcies^r™; 

e$ V 

: Comples with organizational 
endorsed 

proceduresfpolfcies^rlfKtipies 
when prompted 

Copies with organizational endorsed 
prdJdures.^dicies/pte€ipSes; adapts ’when 
/eeessaryto meet customers needs 

Operates dridly according to policy, 
wthod regsrdtoexceeding 
customer standards 

Opiates strictly 
scoring to policy , 
without regard to meethg 
customer standards 

i Extent to which job incubate 

Aggressive reacts/responds negatively or impulsively to 

lillllBlfltfH: guests 

Shows no concern for 
nseds/rpts of others 

^Deferential to others, submits 
eeateio quests needs, rights, d 
X judgments jf 

Balances guest needs/rights with that of the 
organization and your own 

Intial deference, followed by 
aggression; however, able to meet 
guest needs 

Feads/responds 
negatively or impulsively to 
guests needs, rights, or 
judgments 
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Event Response to Performance Factors 


Event 1 

Guest Role 

Customer Service 
Representative Response 
Options 

Behavioral Steps 
Measured 

Rubric Performance 
Factor Dimensions 



1) Hello sir, yes this is reception, due 
to technical difficulties some of our 





guests are experiencing sub-standard 
rooms, we currently do not have a time 

1 . Active listening 

Verbal/ Nonverbal 
Communication 


“Hello. Is that reception? It’s 
Mr. Jenkins here on the 4rth 
floor. I’ve just checked in after a 
long haul flight, and 1 must say 
my room is an absolute 
disgrace.” 

frame as to when we will be able to 
address these issues. 




2) Hello, yes this is reception. I'm sorry 
to hear that your room is not 
satisfactory. Can 1 ask what the 
problem is Mr. Jenkins? 

2. Restate the problem 

Adherence to Policy 

Player moves towards telephone 
and has an interactive 
conversation with angry 
customer. 

3) Mr. Jenkins 1 can only apologize. 
This is totally unacceptable, firstly may 
1 offer you a complementary meal and 
drinks whilst 1 contact house keeping? 

3. Accept responsibility to 
the problem 

Problem Identification 


"Excellent, that’s great. 1 

1 ) I'm afraid the complementary meal 
is limited to one sir, however, 1 can 

4. Determine course of 

Passive / Aggressive 


presume 1 can bring my family?" 

offer you a 50% discount on the other 
members of your party. 

action 


“1 suppose that will have to do, 1 
can’t say that I’m happy." 

2) Of course not a problem, can 1 just 
ask what room you are in so that 1 can 
apologize in person. 

5. Follow-up with guest 



"1 suppose that will have to do, 1 
can’t say that I’m happy." 
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Scenario-Driven Assessment 


• Simulations and games provide authentic situations and 
participant responses against idealized criteria. 

• Performance metrics are automatically captured during 
key decision points/events within the scenario 

- Measuring and providing feedback on performance within each 
scenario event 

• Performance task decomposed into a series of measurable 
behavioral actions 

- Performance measured against standardized performance criteria 
Performance Factor Dimensions (PFDs) 

• Event branching provides primary dynamic feedback 

• Emphasis is on problem solving using authentic policy / resources 

• Customized to meet performance objectives / client needs 

- May vary from site to site 
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Performance Dashboards 

Management requires transparency across critical organizational processes 
from initial activity to aggregate output to performance outcome against key 
performance indicators. 

OEI’s Performance Dashboards and Control Panel Module (PDCM) suite can 
integrate with virtually all organizational databases or applications. 
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Solution 

• Mature Technology 

• Enabled Developer Work Force 

• Affordability 

• Precision 

• Articulation 

• Flexibility 

• Maintainability 


CASPIAN LEARNING 
Engaging Minds 


http://www.caspianIearning.co.uk 
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Solution Benefits 


• Leveraging the Thinking Worlds ™ game engine allows Oshynee 
to develop simple or complex situated performance environments. 

• Supports a variety of ISD Approaches but naturally provides for 

“Guided Discovery” : 

- Higher learner engagement - because the technologies are extremely 
interactive and games based, the engagement factor is way beyond 
other learning experiences 

- Accurate contextualisation - because the learning journeys occur in 
salient environments and utilise realistic scenarios the context and thus 
transference are improved 

- Improved thinking skills - because the tasks within the technology are 
based on learning science, the thinking skills are improved and more 
reliably transferred to the job 

- Precise performance measurement - the core technology allows event / 
behaviour relationships to be monitored and reported. Finely grained 
data can be used to assess performance and transferred into a range of 
feedback / reports including enterprise digital data dashboards 
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A Last Word On Why This 

Method Works 


• Adult learners are increasingly driven by perceived relevance to 
their personal and professional goals. 

• When personal goals and resources are aligned to organisationally 
valued performance, the results are more predictable than when 
learning objectives are ambiguous and only a passing grade is 
considered the goal. 

• Conservation of effort can be achieved by allowing adaptive paths to 
performance goals, the adult learner is further incentivized to focus 
mental energy on the learning task. 

• Multiple benefits come from this approach, including improved time 
to train , time to competency, and greatly enhanced learning transfer 
on the job. 
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Why Use Games for Evaluation? 


• Activity-feedback dynamic that is understood by the learner as a 
“cycle of expertise”. 

• Relevant situations provide the basis for thoughtful problem solving 
with game responses that reinforce “good strategies” while 
stimulating learner refinement of “poor strategies”. 

• When the underpinning expert model provides realistic resources 
the success modeling in a low risk - engaged analytical 
environment can reinforce organizational values, knowledge 
precision, and communication articulation. 

• Measuring competency while providing practical feedback enhances 
learning and is more predictive of workplace performance by 
“normalizing” skills having proven successful and inhibiting 
behaviors found to be unsuccessful (when a success model is 
available as an alternative). 

• Effective games repeat this cycle again and again within a 
recognizable structure - overt modeling — guided discovery in 
practice. . . . it’s an effective process to develop expertise 
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Myths About VR 
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The Virtual Reality - Myth 1 


Games and Sims are something new 
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The Virtual Reality - Myth 3 


Games can not deliver measurable 
outcomes 
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The Virtual Reality - Myth 4 
Serious Games mean Serious Money 




■ Xbox = £5m 




■AA & Hazmat = 
£2- 4m 



■Serious games = 
£20k - £500k 
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Measuring Expertise? 

• Workers are learners 

• Real world experience determines future behaviour 

• Experiences and individual perspective are not uniform so 
the readiness of an individual and their team is not uniform 

• Subjective, situational feedback is important but inadequate 

• The ability to compare a worker’s state of proficiency 
against a precise human capital demand is needed 

• Enter the age of dynamic proficiency measurement and 
feedback 
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